pre-trained deep learning model
Classification of Diabetic Retinopathy using Pre-Trained Deep Learning Models
Al-Kamachy, Inas, Hassanpour, Prof. Dr. Reza, Choupani, Prof. Roya
Diabetic Retinopathy (DR) stands as the leading cause of blindness globally, particularly affecting individuals between the ages of 20 and 70. This paper presents a Computer-Aided Diagnosis (CAD) system designed for the automatic classification of retinal images into five distinct classes: Normal, Mild, Moderate, Severe, and Proliferative Diabetic Retinopathy (PDR). The proposed system leverages Convolutional Neural Networks (CNNs) employing pre-trained deep learning models. Through the application of fine-tuning techniques, our model is trained on fundus images of diabetic retinopathy with resolutions of 350x350x3 and 224x224x3. Experimental results obtained on the Kaggle platform, utilizing resources comprising 4 CPUs, 17 GB RAM, and 1 GB Disk, demonstrate the efficacy of our approach. The achieved Area Under the Curve (AUC) values for CNN, MobileNet, VGG-16, InceptionV3, and InceptionResNetV2 models are 0.50, 0.70, 0.53, 0.63, and 0.69, respectively.
Exploring Naming Conventions (and Defects) of Pre-trained Deep Learning Models in Hugging Face and Other Model Hubs
Jiang, Wenxin, Cheung, Chingwo, Thiruvathukal, George K., Davis, James C.
As innovation in deep learning continues, many engineers want to adopt Pre-Trained deep learning Models (PTMs) as components in computer systems. PTMs are part of a research-to-practice pipeline: researchers publish PTMs, which engineers adapt for quality or performance and then deploy. If PTM authors choose appropriate names for their PTMs, it could facilitate model discovery and reuse. However, prior research has reported that model names are not always well chosen, and are sometimes erroneous. The naming conventions and naming defects for PTM packages have not been systematically studied - understanding them will add to our knowledge of how the research-to-practice process works for PTM packages In this paper, we report the first study of PTM naming conventions and the associated PTM naming defects. We define the components of a PTM package name, comprising the package name and claimed architecture from the metadata. We present the first study focused on characterizing the nature of naming in PTM ecosystem. To this end, we developed a novel automated naming assessment technique that can automatically extract the semantic and syntactic patterns. To identify potential naming defects, we developed a novel algorithm, automated DNN ARchitecture Assessment pipeline (DARA), to cluster PTMs based on architectural differences. Our study suggests the naming conventions for PTMs, and frames the naming conventions as signal of the research-to-practice relationships in the PTM ecosystem. We envision future works on further empirical study on leveraging meta-features of PTMs to support model search and reuse.
Beijing AI academy unveils world's largest pre-trained deep learning model
The Beijing Academy of Artificial Intelligence (BAAI) unveiled a newer version of its hyper-scale pre-trained deep learning model, the country's first and the world's largest, at an ongoing AI-themed forum in Beijing, in the latest signal of China's ambition to become a global leader in AI. The latest version of the model, known as Wudao, literally meaning an understanding of natural laws, sports 1.75 trillion parameters, breaking the record of 1.6 trillion previously set by Google's Switch Transformer AI language model, the academy announced Tuesday at the three-day forum that runs through Thursday. Wudao was only initially released in March. Wudao is intended to create cognitive intelligence dually driven by data and knowledge, making machines think like humans and enabling machine cognitive abilities to pass the Turing test, Tang Jie, BAAI's vice director of academics, said during the forum. The newer version of Wudao is both gigantic and smart, featuring its hyper scale, high precision and efficiency.
Using Deep Learning to Find Insights in Mounds of Messy Data
Deep learning allows us to teach a computer by example. This enables a knowledge worker to throw examples at the computer and use them to teach it how they want their data to be analyzed and understood. In the context of unstructured data where it is often very difficult to codify all the underlying rules that make something interesting, this goes a long way. This approach allows us to approximate human intuition and is a big part of the reason why deep learning techniques deliver the best accuracies today. Second, is the emergence of transfer learning.